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(54) Interactive learning systems 

(57) A computer method of automalrcally providing 
a paperless, individualized, learning sequence includes 
the step of storing in a computer-readable database a 
plurality of questions directed toward assessing an indi- 
vidual's understanding of a selected teaming objective 
for each mender of a plurality of different leaming ob- 
jectives. Next, the mdrvidual is automatically evaluated 
by randomly and sequenlially selecting from !he data- 
base at least one questim associated with each menv 
ber of the plurality of leaming objectives and displaying 
each selected question to the individual for a response, 
wherein each response is received and evaluated rela- 
tive to a predetermined standard before the next ques- 
tion is selected (step 122). Next, at least some ol the 
results ol the evaluations are accumulated in a compu- 
ter storage unit in computer-readable fomi (step 124) 
and the results processed to automatically produce a 
specific sequence of tnslructional units in response to 
those responses which varied materially from the re- 
spective standard (step 126). Finally, the sequence of 
instructional units ars presented on a display for the in* 
dividual (step 130) wherein the individual can interact 
with each of the units via the di^lay 
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Description 



CoTT^uter-based interactive learning systems are known. One particular example is described in U.S. Patent No. 
5.395.243 to Lubin et at. entitled Interactive Learning System and which is Assignee to the Assignee hereof. The 
s specilicalion and figures of the Lubtn et al. patent are incorporated herein by reference. 

Lubin et al. describes a computer-based interactive learning system wherein a user can be assisted in learning 
how to use a pre-writlen application program. Typicat application programs include word processing or spread sheet 
operalbn or operating systems. Lubin et al. describes three different learning paths. One of the learning paths is a 
preset lesson path in which the user goes through a sequence of audio visual lessons relating to various predetermined 
10 features of the application program being studied. Upon completion ol the lesson sequence, the user is then given an 
opportunity to work with the actual application program to re-enforce the previously provided instruction. 

In a second learning path, the user may independently select a topic relating to an aspect of the application program 
which is being studied. The user will then receive audio/visual lessons and/or electronically displayed material relating 
to that topic. 

IS In a third teaming path, the user is able to execute the application program wthoul receiving any training ol the 

type provided by Lubin's system. During this sequence however, the user may access various help files which can 
present electronic textual reference information relaiing to that application program while the program is running. This 
process can be carried out wrihoul having to exit the application program. 

The above-described types of learning paths have been found to be useful and effective for many users. Lubin's 

20 system, however, did not incorporate any capability to evaluate a user's level ol sloll prior to executing any ol the 
learning paths. It would be desirable to be able to combine systems of the type taught by Lubin with a fractional capability 
to take into account a user's initial level of skill, il any 

Thus, there continues to be a need lor interactive learning systems which lake into account a user's initial skill 
level. It would also be desirable if a user were able to combine lesson elements to create an individualized learning 

2S experience apart from any pre-established learning paths. 

According to an embodiment of the present invenlion, an interactive teaming system and method are provided 
and can be used lor learning a selected, pre-written program. Preferably, a paperiess, individualized, learning sequence 
can be developed and presented to the respective user tor the purpose of improving a user's skill and understanding 
with respect to given subject matter. 

30 An apparatus embodying the present invention may incorporate a preslored, machine-readable database having 

a plurality of questions or exercises which are directed toward assessing the individuals understanding of a sefected 
learning objective. Pluralities of questions may be provided for each member of a plurality ol different learning objec- 
tives. 

The apparatus may carry out an automatic evaluation of the individual by sequentially selecting from the database 
3S at least one ol the questbns or exercises associated with each member of the plurality of learning objectives. The 
selected question or exercise may be di^layed for the individual who in turn enters a response. Each of the responses 
that is received may be evaluated relative to a predetermined standard before the next questiwi is selected. 
The system may accumulate the responses and the results of the evaluations for subsequent processing. 
The apparatus may in turn produce Irom the results of the evaluations a sequence of instructional units, based on 
10 those responses which varied materially from the respective standard which are intended to improve the user's skills 
on an individualized basts. The sequence of instructional units can then be presented on a display for example, for 
the individual. The individual can then progress through the sequence of units so as to improve selected skills in 
response to the prior evaluation. 

In one embodiment ol the present invention, subsequent to completing execution o( the sequence of instructional 
^ units, the user can then go through a post-learning evaluation or test for comparison purposes. 

In yet another embodiment of the present invention, a user can select from among a number ol object elements 
lo independently create a personalized teaming experience. At a first level, topic-type object elements can be selected 
which contain, tor example, a single objective and an assessment capability At a higher level, lesson-type object 
elements can be selected. Ttie lesson-Iype object elements incorporate a plurality ol related topic-type object etemwits. 
so In anottier embodiment of ihe present invention, at yet another level, unit-type object elements can be selected. The 
unit-type object elements may incorporate a plurality ol related lesson-type object elements. 

In ye! another embodiment of the present invention, learning-type objects can be grouped together and associated 
because they incorporate related subject matteror one functions as a prerequisite to another. Similarly, unit-type objects 
can in turn be associated with one another because they incorporate related subject matter or because some of them 
55 represent prerequisites for others. 

Reference will now be made, by way ol example, to the accompanying drawings, in which: 

Fig. t is a block diagram ol a system embodying the present invention; 
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Fig. 2 is an overall flow diagram of the process of creating an individual learning profile; 

Fig. 3 is a rnore detailed flow diagram of one aspect of the process of Fig. 2; 

Fig. 4 is a more detailed flow diagram of anotficr aspect of the process of Fig. 2; and 

Fig. 5 is a flow diagram ot a process ol selecting learning objects for the creation of a personal learning experierwe. 

5 

White this invention is susceptible of embodimsnt in many different forms, there are shown tn the drawings and 
will be described herein in detail specific embodiments thereol with the understanding that the present disclosure is to 
be considered as an exemplificalion of the principles of the invention and is not intended to limit the invention to tfie 
specific embodiments Itluslraled. 
10 Figure 1 illustrates an interactive learning system 10 which incorporates a plurality ol components. The system 10 

includes a control unit 12, 12 are read-only memory 14 and read-write memory 16 which communicate with the proc- 
essor 12 via a brdireclional bus structure 18. The memories 14, 16, as is known in the art, can be used to permanently 
or temporarily store constants, programs being executed, or related data. 

Also coupled to the bus 1 8 is a monitor, such as a CRT-type display 20. loud speakers 22. magnetic disk drive 24. 
IS CD-Rom Drive 26 and a user input device 28. The user input device 28 could be a keyboard, or alternatively a mouse. 

In addition, a local area network (LAN) interface 30 enables the system 10 to communicate with the local network. 
Further, a remote network interface 32 provides bidirectional communication with the Worldwide Web or other remote 
networks either through telecommunicalions w through other forms ot data transmission without limitatran. 

In normal operation, programs can be stored on and read from disk drive 24 or CD-Rom drive 26. Graphics can 
20 also be read from the CD-Rom drive. Both the disk drive 24 and the CD-Rom drive 26 can be used as sources from 
which databases can be accessed. 

During normal operation ol the system 10. visual information in lessons can be displayed on the display unit 20. 
under conlrol of the processor 1 2. Text and graphics can be read from disk drive 24 or CD-Rom drive 26 for the purpose 
of displaying same to the user. As win be discussed subsequently, a control program for the purpose of carrying out 
25 the inleraclive leaming process can be stored on one or both of disk drive 24 or CD-Rom 26 lor access by processor 
12. Processor 12 is thus able to carry out a preslored process which provides for individual assessment of a user's 
skills prior to the user going through the interactive teaming process. 

Figure 2 is a ftow diagram illustrating various steps of a method embodying the present invention. In a step 100, 
the operating system for the system 10 is started, in a step 102 execution of the interactive learning system applkiation 
30 program, of a type, tor example, described in Lubin but for use with an icon-driven operating system such as available 
under the Trademark Windows 95 is started. In a step 104 the leaming system carries out an initial sequence of dis- 
playing titles and related text. When the system exits the initiating step 104. the user can select an introduction in a 
step 106 or can sleet to turn directly to the course associated with the system in a step 108 

In a step liO, a user can enter a course overview and pro-assessment testing sequence. After passing through a 
course overview in a step 112, the user enlers the beginning of a plurality of pre-assessment sequences indicated 
generally at tl4A. 114B...114N. The steps o( a selected pre-assessment sequence are similar so a description ol the 
sequence tl4a will also describe sequences 1148.. .114N. 

In a step 120, instructions are presented on the display 20 for the user as to how to carry out the pre^ssessment 
process Subsequently, in a step 1 22 a plurality of questions or exercises are displayed, one at a time, in random order 
on the display 20. The user responds to each of the questions or exercises using the keyboard or nvmse 28 and the 
responses are stored by the processor 12. In a step 124, the responses are compared to a pre-established standard, 
also stored In the disk drive 24 or the CD-Rom drive 26 to assess the performance of the user. For example and without 
limitation, it questions are jwesented to the user, they can be ranged so as lo have right or wrong answers or to have 
more preferred vs. less preferred answers whch can be in turn reflected in the pre-stored standard. The correlation 
fs between the answers received from the user during the step 122 and the appropriate or desirable answers as reflected 
in the prestored standard, provides a basis for establishing a quantitative assessment of user performance. Subsequent 
lo the step 124, if an individualized learning profile is to be produced based on the sequence 114a, that profile is then 
produced in a step 126. Subsequent lo the step 126, the leaming units can be presented lo the user in a step 130 
discussed subsequently. 

so If desired, prior to generation of the indivkJualized learning profile in the step 126, additional pre-assessment se- 

quences 1148.. .114N can be executed to provide a composite leaming profile. 

Figure 3 illustrates in more detail the generation of the individualized leaming track as illustrated in the step 1 26. 
Test items 1-1...1-N tobe presented In the step 122 are preslored in one of the disk drive 24 or CD-ROM drive 26. In 
the step 122a, one of the test questions or exercises is selected and presented to the user on the display 20, The 
answer or response received via the friput device 28 iscompared to a previously-stored answer in a step 122b, If the 
answer is unsatisfactory, the objective associated with the test item and the associated t(^ic are retrieved in respective 
steps 122c. I22d. At least the associated topic is then added to the individual leaming prolile in a step 122e. If the 
question is answered correctly in the step 122b, a deiemiination is made in the step 122f if the testing sequence is 
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finished. If it is not finished, (he next test item is selected. It the lest sequence is finished, either (he next lexl sequence 
114b is entered or (he learning sequence associated with the individual profile is then executed in the step ISO- 
Examples of lest items follow as Examples 1 and 2. Example 1 illuslrales two diflereni matching-type test items. 
Example 2 illustrates two different prcx:ess educating test items. 

s 

Example 1 
Objective: 

10 fdenlify the Explorer iealures to view files and folders. 

Related Topic(s): 

Changing the Display 
IS Expanding and Collapsing Folders 

Test Hem 1: (question type = matching) 

Match the button to the lask it performs: 

20 

a. Displays files as large icons 
b; 1^ Displays file names in a list 
25 c: ImI Displays file information for each file 
d: * Opens a lolder 
e: J Closes a folder 

30 

Test Hem 2: (question type = nnatching) 

Match the feature to the desired outcome. 

3S a: Arrange by Date Orders file names by last modification 

b: Arrange by Size Lists file names according to their space requirements 

c: Arrange by Type Displays all text documents 

d: Plus Sign Displays the files in a lolder 

e: Minus Sign Closes an open tofcJer containing Dies 

40 

Example 2 
Objective: 

Preview a file using Quick View on the sortcut menu. 
Related Topie(s): 
Quick View 

so 

Test Hem 1 : (question lype=simulatlon) 

Complete (he steps to see a Quick View of HEPORTl DOC using the shortcut menu. 
S5 Test Item 2: (queation type=slmulation) 

Complete the action to preview a Quick View of Agenda doc using the shortcut rrtenu. 

Figure 4 is a flow diagram illustrating in mora detail executkin of the personal learning sequence, step 1 30. Where 
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the personal learning sequence, created in Ihe step 122e includes a plurality of topics Ty Tf^ the system 10 presents 
each of the selected topics in a series of steps ...130-N to Ihe user via the display 20. The user can interact with 
the various presented topics via Ihe keyboard or mouse 28 during the process of going through that particular individ- 
ualized leamingsequence. Subsequent to exiting the learning sequence. Ihe system 1 0 can present a postnassessment 
test in a step 1 32 to determine the level of skill that the user has improved to as a result ot the process. A similar set 
of steps can be carried out to implement Ihe personal learning sequence for each ot the units ..Un- 

Hence, when completed, the user vnil have experienced an individualized learning sequence in connection with 
one or mots ol the units 1 -N. The user can then exit to the step 1 09 and enter the application or other program being 
taught for direct execution or can enter additional course unils for further tnstruclion. 

Fig. 5 illustrates an overall flow diagram lor an alternativB approach to creating a personalized learning experience 
based on collecting together a plurality of separately-accessible learning objects. The learning objects are contained 
in an accessible database which Is organized in several different ways, having both hierarchical and contact-sensitive 
aspects. 

A course object is made up of a plurality ol independently -accessible unit objects. Unit objects are learning objects 
which include a plurality of independent lesson dsjects. Lesson objects, in turn, are also learning objects whic^ are 
made up ol a plurality of dependent topic c^jects. Topic objects are dependent objects which contain a single objective 
and an assessment. 

The content ol a leamrg object is illustrated, in an overall sense, in block 150 of Fig. 5. 

Ttie lesson objeci is the smallest independent instniciional activity available to a user A given lesson object exhibits 
internal cohesion and is focused about a plurality of dependent topic objects. 

A lesson object incorporaies a plurality of objectives as welt as a second plurality of lest or assessment items. It 
also incorporates predefined sequencing and interactions beiween related, dependent, topic objects. 

Lesson objects can be linked with other lesson objects or can stand alone. Topic objects, by way of contrast, are 
dependent on the associated lesson object and contain only a single objective and an associated assessment. 

As illustrated in block 1 52 of Fig. 5, learning objects can be implemented oul of a plurality oJ linked pages. The 
pages can be linked together both linearly and non-tinearly. Pages can contain text, multi-media components and user 
interaction logic. 

Alternatively. learning objects can be grouped together as a result of content or because one or more sen/es as 
a prerequisite lor another, as illustrated in element 154 ol Fig. 5. 

A plurality of learning objects can be selected via a User through an object access program 156. The User can 
select, via the access program 1 56, one or more lesson objects to be experienced for the purpose of addressing an 
education or training objective. Learning objects can be stored on a variety of media such as magnaltc disc drives and/ 
or CD Rom drives. The object access program 1 56 can ba accessed by the User not only directly through a tocat area 
network but also remotely via the Internet and the Wbrldwide Web. if desired. 

From the foregoing, it will be obsen^ed that numerous variations and modifications may be eflected without de- 
parting from the spirit and scope of the invention. It is to be understood that no limitation with respect to the specific 
apparatus illustrated herein is intended or shoukJ be inferred. It is, ol course, intended to cover by the appended claims 
all such modifications as fall within the scope ol the claims. 



Claims 



1. A computer based method ol automatically providing a paperless, individualized, learning sequence comprising: 

storing in a computer readable database a plurality of questions directed toward assessing an individual's 
understanding ol a selected learning objective for each member ol a plurality ol different teaming objectives; 
automatically evaluating the individual by randomly and sequentially selected from the database at least one 
question associated with each member o( the plurality of teaming objectives and displaying each selected 
question to the individual tor a response wherein each response is received and evaluated relative to a pre- 
determined standard before the next question is selected; 

accumulating at least some ol the results ol the evaluations in a computer storage unit in computer readable 
fomi; 

processing the results to automatically produce a specific sequence of instructional units in response to those 
responses which varied materially from Ihe respective standard; and 

presenting the sequence of instructional units on a display lor the individual wherein the individualcan interact 
with each ot the units via the display. 

2. A method as in claim i wherein in storing step, at least some of the questions are linked to a plurality ol possible 
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answers and in th© displaying step, at least the salecled question and the pluralily of possible answers are dis- 
played. 

A method as in claim 1 wherein in the storing step, some of the questions are stored in a form virfiich directs the 
individual lo achieve a specified result without specifying the actions to be taken. 

A method as in claim 1 which includes presenting a performance evaluating test, subsequent lo presenting the 
sequence of instructional units. 

An apparatus for providing an automatic, paperless, individualized learning sequence lo a user comprising: 

a programmable processor; 

a visual display coupled lo the processor; 

a unit coupled to the processor, for reading control information and a database from a medium and providing 
that information lo the processor and wherein, in response to that information, the processor accesses the 
database and wherein the processor includes circuitty (or randomly selecting from the database a plurality of 
assessment questions and circuitry lor presenting ths plurality d questions lo the user on the display; 
a user operable input device coupled to the processor, whereby the user provides responses lo the processor 
to at least some of the assessment questions and wh wein the processor includes further circuitry for evaluating 
the responses and in response thereto for establishing a sequence of selected topics for presentation to the 
user. 

A system as In claim 5 wherein the processor includes further circuitry for presenting the sequence of selected 
topics lo the user. 

A system as in claim 6 wherein the processor includes further circuitry for reading from the database a post-test 
and circuitry lor presenting the posi test to the user 

fi<r\ individualized, paperless, learning system comprising: 

a database ol different teaming objects; 

a control unit wilh circuitry for enablhg a user to select an individual sequence of learning objects from the 
database; 

a display unit coupled to the control unit whereat the conlrol unit is adapted lo display the individual sequence 
of leaning objects. 

A system as in claim 8 wherein the control unit includes circuitry for linking the objects in the individual sequence. 
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Fig. 2 
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Fig. 3 
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Fig. 4 
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Fig. 5 
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